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classical ones proposed in the literature. It is based on an exponential regression model that was 
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1 Introduction 



Let Xi, ...,X„ be a sequence of independent and identically distributed (i.i.d.) random 
variables with distribution function F. In the present paper, we assume that F is a 
Weibull tail-distribution, which means that 

1 - f (x) = exp(-H(x)) with H-\x):=mf{t:H{t)>x} = x^£{x), (1) 

where > denotes the Weibull tail-coefficient and ^ is a slowly varying function at 
infinity satisfying 

£(Ax) 

-^-^ — > 1, asx ^ oo, for all A > 0. (2) 

€(X) 

Based on the limited sample Xi, ...,X„, the question is how to obtain a good estimate 
for a quantile of order 1 - p„, p„ — > defined by 

Xp„ = infly : f (y) > 1 - p„}, 

such that the quantile to be estimated is situated on the border of or beyond the range of 
the data. Extrapolation outside the sample occurs for instance in reliability (Ditlevsen, 
1994), hydrology (Smith, 1991), and finance (EmbrechtsetaL, 1997). Beirlantetal. (1996) 
investigated this estimation problem and proposed the following estimator of Xp„: 

''P""^"-'""''"ilog(nA,)j ' 

where Xi^„ < ... < X„,„ denote the order statistics associated to the original sample and 
0„ is an estimator of 6. One can use for instance the estimator introduced in Diebolt et 
al. (2006): 

^" = rT\^ log("/0 (log(X„_,+i,„) - log(X„_,;„)) . (4) 

We refer to Gardes and Girard (2005) for a study of the properties of (O. In the preceding 
equations, k„ denotes an intermediate sequence, i.e. a sequence such that kn ^ oo and 
kn/n ^ as n ^ oo. See Broniatowski (1993), Beirlant et al. (1995, 1996), Girard 
(2004), and Gardes and Girard (2006) for other contributions to the estimation of 6 
and Beirlant et al. (2006) for Local Asymptotic Normality (LAN) results. Denoting 
T„ = log(l/p„)/ log(n/fc„), the estimator © can be rewritten as 

v' — Y T^" 

-^Ph ~ -^n-k„+l,n i-n ■ 

It appears that the extreme quantile of order 1 - p„ is estimated through an ordinary 
quantile of order 1 — k„/n with a multiplicative correction x^". 

It will appear in the next section that Xp„ exhibits a bias depending on the rate of 
convergence to 1 of the ratio of the slowly varying function { in Q. In order to quantify 
this bias, a second-order condition is required. This assumption can be expressed as 
follows: 

Assumption {Re{b, p)). There exists a constant p < and a rate function b satisfying b{x) — > 
fls X — > oo, such that for all e > and 1 < A < oo, we have 

log(^(Ax)/Ax)) 



sup 

Ae[l,A] 



b{x)KJA) 



1 



< e, for X sufficiently large, 
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with Kp{A) = f^^ tP-^dt. 

It can be shown that necessarily \b\ is regularly varying with index p (see e.g. Geluk 
and de Haan, 1987). In this paper, we focus on the case where the convergence Q is 

slow, and thus when the bias term in &„ and therefore in Xp^ is large. This situation is 
described by the following assumption: 

x\b{x)\ oo as X ^ oo, (5) 

which is fulfilled by Gamma, Gaussian and !D distributions, see Table [H The !D 
distribution is an adaptation of Hall's class (Hall and Welsh, 1985) to the framework 
of Weibull tail-distributions, see the appendix for its definition. The methodology that 
we propose in order to reduce the bias of Xp„ is to use the following regression model 
proposed by Diebolt et al. (2006) for the log-spacings of upper order statistics: 

Zj := i log (n/j) (log(X„_y+i,„) - log(X„_y,„)) 

= |0 + fc(log(n/U)(^|J^jj/; + OF(&(log(nA„))), (6) 

for 1 < y < kn, where {fi,—,fk„) is a vector of independent and standard exponen- 
tially distributed random variables and the Op-term is uniform in /. This exponential 
regression model is similar to the ones proposed by Beirlant et al. (1999, 2002) and 
Feuerverger and Hall (1999) in the case of Pareto-type distributions. The model (O 

allows us to generate bias-corrected estimates 6n for 6 through a Least-Square (LS) 
estimation of 6 and b{log{n/k„)). The resulting LS estimates are then the following: 

dn = Z^„ -b (login /k„))xk^ 
b (log(n/fc„)) = 2^(xy - XkJZj Yj^Xj - Xk,f 

j=l I ;=1 

where Xj = log(n/fc„)/log(n/;), Xk„ = T„^%i^i = r„L%iZj. The asymptotic 

normality of the LS-estimator d„ is established in Diebolt et al. (2006). Now, in order 
to refine Xp„, we can use the additional information about the slowly varying function 
£ that is provided by the LS-estimates for 6 and b. To this aim, condition {Re{b, p)) is 
used to approximate the ratio f "^(1 - pn)l^n-k„+i,n, noting that 

Xn-k„+l,n = F ^{U„-k„+-i,n), 

with Ui^n < ... < Un,n the order statistics of a uniform (0, 1) sample of size n, 

Xn-kn+l,n F ^{Un-k„+l,n) 

{-\0g{pn)r ^(-l0g(p.)) 



(-log(l - Un-k.M,n)r ^(-log(l - Wn-)c„+l,n)) 
(-l0g(p„))^ ^(-log(Pn)) 
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^ l0g(l/Pn) ^ 

Jog(n/?c„), 



exp 



b(log{n/kn)) 



/ log(l/p„) \P 
liog(»A»)/ 

p 



The last step follows by replacing Uk„,n with kn/n. Hence, we arrive at the following 
estimator for extreme quantiles 



b {\og{n/k„)) - 



Pn 



or equivalently, 

Xp„ = Xn-k„+l,n In' exp (F(log(n/?C„))Kp;,(T,0) . 

Here, p^, is an arbitrary estimator of p. It will appear in the next section (see Theo- 
rem mii)) that, if T„ converges to a constant value t > 1, one can even choose 'pn = p*a 
constant value, for instance the canonical value p* = -1, as suggested by Feuerverger 
and Hall (1999). Note that the estimator ^ can be seen as a particular case of ob- 
tained by neglecting the bias-term. In the following, we use the LS-estimators of 6 and 
b defined previously. The study of the asymptotic properties of the extreme quantile 
estimators xj,„ and Xp„ is the aim of Section |2l An adaptive selection procedure for k„ is 
also proposed. A simulation study as well as a real data set are provided in Sections |3] 
andlH Proofs are postponed to Section |5l 

2 Bias-reduced extreme quantile estimator 

The asymptotic normality of our bias-reduced extreme quantile estimator x^,^ is estab- 
lished in the following theorem. 

Theorem 1 Suppose © holds together with (Re{b, p)) and ©. We assume that 

kn ^ oo, b (login/kn)) ^ A G R, (7) 



and z/A = 0, 



■ oo and - — ^—prr — > 0. (8) 



login /kn) login /kn) 

Under the additional condition that 

lp;-pliog(T„) = Op(i), (9) 

we have 

(i) ifzn^oo 

(ii) ifzn — > T, T > 1, and if we replace 'pn by a canonical choice p* < 0, then 

^ (log(rp„) - log(Xp„)) ^ TV (A^(t), 0^a^(T)) , 



login/kn) 
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with 
and 



CT2(T) = (V(T)-log(T))', 
^(T) = (Kp*(T)-Kp(T)). 



In the following remark we provide some possible choices for the sequences (fc„) and 
(P«)- 

Remark 1 Suppose © holds together with (Re{b, p)) and dS]). Then, choosing 

/ log(n) \ _ ^ it 

= ^T7^ — TT: , a 0, p„ = n ^ t > 1, flnrf p„ = p < 0, 
\ Klog(n))/ 

TheoremW[ii) applies and thus 

Clearly, the faster b converges to 0, the faster 'x'p^^ converges to Xp„. 

As a comparison, one can establish similar results for Xp„. 

Theorem 2 Suppose ([I]) holds together with {R{{h, p)) and ©. We assume that 

k„ oo, A/fc^&(log(n/fc„)) ^ A G ]R,liminf T„ > 1, 
flnd z/ A = 0, log(fc„)/ log(n) 0, we have: 



log(T„) 



log(Xp„) - log(Xp„) - b{log{n/k„)) 



log(T„) 1^ / log(n/;) ' 



The next corollary allows an asymptotic comparison of Xp„ and Xp„. 
Corollary 1 Under the assumptions of Theorem^ we have 
(i) ifzn^oo 



log(T„) 



(log(5p„)-log(Xp„))^yV(A,0^), 



(ii) z/t„ t,t > 1, then 



with 
and 



V^(log(ip„) - log(Xp„)) ^ yv(A/I(T),02a2(T)), 
a2(T) = log2(T), 

/i(T) = (log(T) - Kp{T)) . 



In the situation where t„ — > oo, clearly log(x'p„) is asymptotically unbiased whereas 
log(XpJ is biased. When t„ — > x, x > 1 both estimates are asymptotically biased but the 
bias of log(x^J can be smaller than the one of log(XpJ if p* is close to p. 
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Let us now introduce the empirical adapted Asymptotic Mean Squared Error (AMSE*) 
of Xp„ defined as 

AMSE*(xpJ = Asymptotic E (log(Xj,„) - log(Xp„)) . 

Note that we use an adapted version of the AMSE since it takes into account the 
fact that the distribution of the quantile estimators is found to be closer to a lognormal 
distribution than to the asymptotic normal distribution. This is classical in the literature, 
see for instance Matthys et al. (2004). As a consequence of Theorem |2l we have 

AMSE (5,„) = e ^— + h (log(nA„)) ^ (l^^j - ■ (10) 

We can now take benefit of the estimation of fc(log(n/fc„)) by estimating the AMSE* 
given in (|T0)) by: 

AMSP(J,„) = (0„) ^— + (Klog(nA„))) ^ (i^^j + - 1| • 

Note that, in the latter formula, we replaced p by a canonical choice (p = -1) instead of 
estimating this parameter. In fact, this second-order parameter is difficult to estimate in 
practice, and we can easily check by simulations that fixing its value does not influence 
much the result (see e.g. Beirlant et al., 1999, 2002 or Feuerverger and Hall, 1999). Then, 
the intermediate sequence fc„ can be selected by minimizing the previous quantity: 

kn = argmtn AMSE*(3cpJ. 

This adaptive procedure for selecting the number of upper order statistics is in the 
same spirit as the one proposed by Matthys et al. (2004) in the case of the Weissman 
estimator (Weissman, 1978). In order to illustrate the usefulness of the bias reduction 
and of the selection procedure, we provide a simulation study in the next section. 



3 A small simulation study 

First, the finite sample performance of the estimators Xp„ and are investigated on 4 
different distributions: |yV(0,l)|, 1(0.25,0.25), £)(1,0.5) and ^(0.25,0.25). It is shown 
in Gardes and Girard (2005) that Xp„ gives better results than the other approaches 
(Hosking and Wallis, 1987; Breiman et al., 1990; Beirlant et al., 1995). This explains why 
x^,, is only compared to the estimator Xp,,. In the following, we take p„ := p„{t) = n"^ 
with T = 2 and 4 and we choose p~„ = -1. We simulate N - 500 samples iP(n,i)i=i,...,N of 
size n = 500. On each sample iP(„,i), the estimates x^„(t),;/ are computed for t = 2, 4 and 
for k„ =2,..., 360. We present the plots obtained by drawing the points 

(?c„,med,(log(Xp„(^),0)) f or t = 2 and 4, 

where med/(log(x^„(T),0) is the median value of log(x^„(T),,), i = 1,...,N. We also present 
the associated MSE plots 



1 ^ 2^ 
K, T7 (log(^p„(T),/) - log(Xp„(,))) 



^.1 



for T = 2 and 4. 
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The same procedure is achieved for the estimator Xp^ . Results are presented on figures[T]- 
H For the |yV(0, 1)|, 1(0.25, 0.25) and D{1, 0.5) distributions, the bias of log(XpJ is smaller 
than the one of log(Xp J. Let us highlight that, for the latter distribution, a significant bias 
reduction is obtained although 'p„ p. Moreover, bias reduction is usually associated 
with an increase in variance. However, as illustrated in panel (b) of figures 
our estimator is still competitive in an adapted MSB sense. Note that for the 
"1^(0.25,0.25) distribution. Theorem [T] does not apply since xb{x) = 0. In this case, the 
behavior of log(XpJ is slightly better. 

Second, we investigate the behavior of the adaptive procedure for selecting the number 
of upper order statistics in Xp,, . For i = 1,.. .,N and t = 2, 4, we denote by 

J?f = arg min AAiSE*(Ip„(,)j), 

Jc„e[l,n] '^^ ' 

the value selected on the sample i?(n,i)- As a comparison, we introduce the value that 
would be obtained by minimizing the true AMSE*: 

k°f = arg min AMS£*(Xp„(T)). 

k„e[l,n] 

Figures |5]-[8] contain the paired boxplots of the log-quantile estimators log(Xp„(T),;) at the 

adaptively selected values k'^f^' on the right and at the sample fraction k°^^ with smallest 
AMSE* on the left. The horizontal line indicates the true value of log(XpJ. The method 
proposed for the adaptive choice of while not achieving the goal of minimizing 
the MSE, does lead to quantile estimators that exhibit good bias properties while the 
variance is inflated in comparison to the asymptotically optimal values. 

4 Real data 

Here, the good performance of the adaptive selection procedure is illustrated through 
the analysis of extreme events on the Nidd river data set. This data set is standard 
in extreme value studies (see e.g. Hosktng and Wallis, 1987, or Davison and Smith, 
1990.) It consists in 154 exceedances of the level 65 m'^s"^ by the river Nidd (Yorkshire, 
England) during the period 1934-1969 (35 years). In environmental studies, the most 
common quantity of interest is the N-year return level, defined as the level which is 
exceeded on average once in N years. Here, we focus on the estimation of the 50- and 
100- year return levels. According to Hosking and Wallis (1987), the Nidd data may 
reasonably be assumed to come from a distribution in the Gumbel maximum domain 
of attraction. This result was confirmed in Diebolt et al. (2006) who have shown that 
one could consider Weibull tail-distributions as a possible model for such data. The 
WeibuU tail-coefficient is estimated at 0.91. We obtained 321. 5m'^s"^ as an estimation 
of the 50-year return level and 359m''s"^ as an estimation of the 100-year return level. 
Note that these results are in accordance with the results obtained by profile-likelihood 
or Bayesian methods, see Diebolt et al. (2005) or Davison and Smith (1990). 

5 Proofs 

Proof of Theorem [H We decompose our quantile estimator as follows: 

log(Xp„) - log(Xp„) = log(X„_,t„+l,n) + On log(T„) 
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+ 
+ 



+ b (log(n/fc„)) Kp„{Tn) - log ((- log(p„))'^(- log(p„))) 
i ejlog (- log (Uk„,n)) - log log(n/fc„)} 

+ {log £ (- log {Uk„,n)) - log ^ (log(n/fc„))} 
+ |log^(log(nA„)) - log^(-log(p„)) + bi\og{n/K))Kp{T„)] 

' (b (log(n/fc„)) - b (log(n/fc„))) KpS^n) 

bilog{n/K)){KpSTn) - KpiTn)] 
6 

7=1 

We successively discuss each of the terms Bj^k,,, j = 1/ •••/ 6. First concerning Bi,ic„/ remark 
that 

log (- log(LJ,„„)) - log log(n A„) i log (i^gy^) . 

where Ty„ denotes the order statistics from an i.i.d. standard exponential sample of 
size n. Since it is well known that 

^JK (Tn-k.M,n - log(n/fc„)) ^ yV(0, 1), (11) 

we clearly have 



Remark now that 

log(n/fc„)log(T„) log(n/fc„)v / 

by Theorem 3.1 in Diebolt et al. (2006). Next, using {Re{b, p)) and 



(12) 



(13) 



we get 



B^,k„ = log 



I £{Tn-k„+l,n) I 

[{{login/K))) 

[-^^^-^)&(log(nA„))(l+Op(l)) 
[login /k„) I 



ig^-l)Klog(n/U)(1.0p(l)) 



= Oi 



so that under 0, 



f Klog(n/fc„)) ^ 
^fkn\og{n|kn) 



log(n/;c„) log(T„) 



^ V^log(n//c„)log(T„) 



Op(l). 



(14) 



(15) 
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Next, under {R{{b, p)) one has (for a suitably chosen h) that for all e > (see Drees, 1998, 
Lemma 2.1) 



supi 

t>i 



-(e+p) 



b{x) 

Hence, we conclude, choosing e < -p, that 



log £ (login /kn)) - log ^(t„ log(n/fc„)) 



fc(log(n/fc„)) Klog(n/fc„)) 
which implies that, under (O, we have 

log(n/fc„)log(T„) 



+ ^^p(t,0 



^4,^,, = 



1 



Jog(T„)^ 



0(1). 



0, (16) 



(17) 



Next, we can check that, according to ([6]), 



1 ^^ m 

B5;c„=%(t„)^XM/;-1)' 



where 



(Xj - Xkjid + b{\og{n/k„))Xj) 



A direct application of Lyapounov's theorem, combined with Lemma 7.3 in Diebolt et 
al. (2006) yields 

^/K 1 



Therefore 



log(n/fc„) kn j-^ 



2],^,,(/,-i)^yV(o,02). 



log(n/fc„)log(T„) log(T„) 



with 6,.^W(O,0')- 



(18) 



Finally, following the method of proof of Lemma 1 in de Haan and Rootzen (1993), we 
find that 

gP-l (sP«-P -l)ds- (pn - p) J SP-^ log(s) ds 
< \Pn - Pl (J " SP-^ log(s) dsj (zf'-P^ - l) , 

where the first inequality comes from the fact that \ ~ - ~ 1- Hence 



log(n/fc„) log(T„) 



6,/c„ 



log(n//c„) 



Mlog(n/fc„)) 



X (Pn-p) 



^ log(x)dx 

log(T„) 



l + 0(Tlf"-'"-l)). 
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If T„ — > oo, this implies that p„ — > p by the assumption (0) and therefore 

a/F 

, , , , = op(i). (19) 

log(n/fc„) log(T„) 

Combining ^ and dTS]) with (HZll-Gll), Theorem [l^i) follows. If t„ ^ t, t > 1, 
then the normalization factor log(T„) — > log(T) can be omitted in ((T2)l. ((151) ^rid ((17)) 
while preserving the negligeability of these terms. Besides, we can replace 'p„ with any 
canonical choice, for instance p* < 0, and therefore 



login /kn) 



B 



6,k„ 



- ^_^fc(log(nA„))(Kp*(T„)-]<:p(T„)) 

A^iT):=A(Kp,iT)-KpiT)). (20) 

The limiting distribution is then given by ((131) ^rid ((IS) with a bias term due to ((201) . 
To conclude with the second part of our Theorem [1} we have to establish the limiting 
distribution of 

yJknK *iTn) ^ . ^/KlogiTn) . 



)g(w/fcn) 

To this aim, remark that 



log(nA„)>^ 

= ^j,nKp*iT„) + aj,„ log(T„) 



where 
and 



aj,n =(d + bilogin/k„))x,) 



1 - 



Using Lemma 7.3 in Diebolt et al. (2006), direct computations lead to 
Var (cvM -1)) = Yj ~ (log(n/fc„))' cj2(t) 



7=1 



/=1 



and 



E [co,nij, - 1)) = 9 a;J„ ~ CK (log(n/fc„))' , 

7=1 7=1 

where C is a suitable constant. Therefore a direct application of Lyapounov's theorem 
yields 

LZ„^yv(o,0V(T)), 

which achieves the proof of the second part of Theorem (H □ 
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Proof of Theorem m We have: 



^ 1 ^ / loe(n//) \'' T^-l 

log(^;j - log(Xp„) - b{\og{n/K)) log(T,)^ [ lo^(n/kn) j ^ ^(l«g("/^"))^ 



= 0{log(- log(L[,„,„)) - loglog(n/fc„)} 

1 ^ / login /j) ' 
+ dn-e- fc(log n/k„)- y ■ 7 l\ 

+ {log log(Lr,„,„)) - log Alog(n/fc„))} 



log(T„) 



+ log^(log(n/fc„)) - log^(- log(p„)) + fc(log(nA„))^ 



P 



From ((12)), we have 



log(Tn) 



log(n/fc„)log(T„)^ 



Op(l), 



and Theorem 2.2 in Diebolt et al. (2006) states that 



log(T„) 



From ((14)). we have 



BsA, - Or 



f b{\og{n/kn)) ] 
^/Klog{n/kn) 



and thus ^/k^b{log{n/k„)) A eK entails 



-B 



Or 



y/ic^ login /k„)\og{Tn)^ 



log(T„) 

Finally, ((T6)) implies that 

B4,)c„ = Op(fc(log(n/fc„)))/ 
which, combined with yjknbf^oginlkn)) — > A G R yields 



Op(l). 



B4,;c„ - Op 



1 



log(T„) 

which achieves the proof of Theorem [2l 



log(T„)^ 



Op(l), 



□ 



Appendix 

Diebolt et al. (2006) introduced the class of distributions D{a,(i) with distribution 
function given by 

1 - Fix) = exp(-H(x)) where H-\x) := x^'"{l + x'O, 

a and jS being two parameters such that 0<«, 0<j6<l and «jS < 1. Under these 
conditions, the above class of distributions fulfill assumptions ^ with {Re{b, p)) and 
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(O where = p = -j6, i{x) = 1 + x ^ and b{x) = -jSx ^. It is thus possible to obtain 
distributions with arbitrary > and -1 < p < 0. These results are summarized in 
Table [TJ 
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Table 1: Parameters 6, p and the function b{x) associated to some distributions 
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(a) Median as a function of k„ (b) MSB as a function of k„ 

Figure 1: Comparison of log(?p„) (t = 2: continuous line, t = 4: + + +) and log(Xp„) (t = 2: 
dashed line, t = 4: * ★ *) for the \N{0, 1)| distribution. The horizontal lines on the left panel 
represent the true values of log(Xp„) (thin line: t = 2, thick line: t = 4). 




Figure 2: Comparison of log(Xp„) (t = 2: continuous line, t = 4: + + +) and log(Xp„) (t = 2: 
dashed line, t = 4: ★ ★ ★) for the 'W(0.25, 0.25) distribution. The horizontal lines on the left 
panel represent the true values of log(Xp„) (thin line: t = 2, thick line: t = 4). 
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(a) Median as a function of k„ (b) MSB as a function of k„ 

Figure 3: Comparison of log(?p„) (t = 2: continuous line, t = 4: + + +) and log(Xp„) (t = 2: 
dashed line, t = 4: * ★ ★) for the 1(0.25, 0.25) distribution. The horizontal lines on the left panel 
represent the true values of log(Xp„) (thin line: t = 2, thick line: t = 4). 




Figure 4: Comparison of log(Xp„) (t = 2: continuous line, t = 4: + + +) and log(Xp„) (t = 2: 
dashed line, t = 4: ★ ★ ★) for the D(l, 0.5) distribution. The horizontal lines on the left panel 
represent the true values of log(Xp„) (thin line: t = 2, thick line: t = 4). 
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Figure 5: \N{0,1)\ distribution. Boxplots of log(xpJ at the optimal value of kn obtained by 
minimizing the true AMSE* (left), and at the value of A:„ obtained by minimizing the estimated 
AMSE* (right). The horizontal line indicates the true value of log(Xp„). 
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Figure 6: 'W{0.25, 0.25) distribution. Boxplots of log(xpJ at the optimal value of kn obtained by 
minimizing the true AMSE* (left), and at the value of fc„ obtained by minimizing the estimated 
AMSE* (right). The horizontal line indicates the true value of log(Xp„). 
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Figure 7: r(0.25, 0.25) distribution. Boxplots of log(xpJ at the optimal value of k„ obtained by 
minimizing the true AMSE* (left), and at the value of A:„ obtained by minimizing the estimated 
AMSE* (right). The horizontal line indicates the true value of log(Xp„). 
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Figure 8: 2)(1,0.5) distribution. Boxplots of log(xpJ at the optimal value of kn obtained by 
minimizing the true AMSE* (left), and at the value of A:„ obtained by minimizing the estimated 
AMSE* (right). The horizontal line indicates the true value of log(Xp„). 
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